



Avoidance algorithms 




□ Single instance of a resource type 
■ Use a resource-allocation graph 




□ Multiple instances of a resource type 
■ Use the banker's algorithm 
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Resource allocation algorithm (Banker's Algorithm) 

□ Multiple instances 

□ Each process must a priori claim maximum use 

□ When a process requests a resource it may have to wait 

□ When a process gets all its resources it must return them in a 
finite amount of time 



Data Structures for the Banker's Algorithm 



□ Let n = number of processes, and m = number of resources 
types. 

□ Available: Vector of length m. If available [/] = k, there are k instances 
of resource type R- available 

□ Max {Resources): nxm matrix. If Max [ij] = k then process P i may 
request at most £ instances of resource type R - 

□ Allocation: nxm matrix. If Allocation [7 j] = kthen P ; is currently 
allocated £ instances of Rj 

□ Need: nxm matrix. If Need[iJ] = k then P y may need ^rmore 
instances of Rjto complete its task 

Need[iJ]= Max[j,J\ - Allocation [Ij] 
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It is safe state, 
because all 
processes can 
complete its work 
and finish. 
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Example: is the following case in a safe state 
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It is not safe state because all processes can not complete its work and finish 



Deadlock Recovery 



□ Abort all deadlocked processes. 



Abort one process at a time until the deadlock cycle is eliminated. In 
which order should we choose to abort? 
Priority of the process. 

How long process has computed, and how much longer to completion. 
Resources the process has used. 
Resources process needs to complete. 
How many processes will need to be terminated. 
Is process interactive or batch? 



Resource preemption 

Selecting a victim - minimize cost. 
■ Rollback - return to some safe state, restart process for that state. 

Starvation - same process may always be picked as victim - include number 

of rollback in cost factor. 



CPU Scheduling 



□ Maximum CPU utilization is obtained with 
multiprogramming 

■ Several processes are kept in memory at 
one time 

Every time a running process has to wait, 
another process can take over use of the 
CPU 

□ Scheduling of the CPU is fundamental to 
operating system design 

□ Process execution consists of a cycle of a 
CPU time burst and an I/O time burst 

(i.e. wait) as shown on the next slide 

Processes alternate between these two 
states (i.e., CPU burst and I/O burst) 

Eventually, the final CPU burst ends with a 
system request to terminate execution 
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add store 
read from file 


> CPU burst 


wait for I/O 
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► CPU burst 


wait for I/O 




> I/O burst 
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Histogram of CPU-burst Times 
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CPU bursts tend to have a frequency curve similar to the exponential curve shown 
above. It is characterized by a large number of short CPU bursts and a small number 
of long CPU bursts. An 1/0-bound program typically has many short CPU bursts; a « 
CPU-bound program might have a few long CPU bursts. 
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CPU Scheduler 



□ Selects from among the processes in memory that are ready to 
execute, and allocates the CPU to one of them 

□ CPU scheduling decisions may take place when a process: 

1 . Switches from running to waiting state 

2. Switches from running to ready state 

3. Switches from waiting to ready 
Terminates 

□ Scheduling under 1 and 4 is nonpreemptive; they offer no 
schedule choice. 

□ All other scheduling is preemptive; they can be scheduled 



■ 

Dispatcher 

□ The dispatcher module gives control of the CPU to the 
process selected by the short-term scheduler; this involves: 

switching context 

■ switching to user mode 

jumping to the proper location in the user program to restart 
that program 

□ The dispatcher needs to run as fast as possible, since it is 
invoked during process context switch 

□ The time it takes for the dispatcher to stop one process and 
start another process is called dispatch latency 
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Scheduling Criteria 

□ Different CPU scheduling algorithms have different properties 

□ Criteria for comparing CPU scheduling algorithms may include the 
following 

■ CPU utilization - percent of time that the CPU is busy executing a 
process (Maximize CPU utilization) 

Throughput - number of processes that are completed per time unit 
(Maximize throughput)) 

Response time - amount of time it takes from when a request was 
submitted until the first response occurs (Minimize response time ) 

Waiting time -the sum of the amount of time a process has spent waiting 
in the ready queue. (Minimize waiting time ) 

Turnaround time - amount of time to execute a particular process from 
the time of submission through the time of completion (Minimize 
turnaround time) 



Single Processor Scheduling Algorithms 

□ First Come, First Served (FCFS) 

□ Shortest Job First (SJF) 

□ Priority 

□ Round Robin (RR) 

First Come, First Served (FCFS) 

With FCFS, the process that requests the CPU first is allocated the 
CPU first 

The FCFS scheduling algorithm is non-preemptive 

Once the CPU has been allocated to a process, that process keeps 
the CPU until it releases it either by terminating or by requesting I/O 



V 



1 ■ 

First Come, First Served (FCFS) Scheduling 

Process Burst Time 
Pj 24 
P 2 3 
P 3 3 

□ Suppose that the processes arrive in the order: Pj , P 2 , P 3 
The Gantt Chart for the schedule is: 
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□ Waiting time for PI = 0; P2 = 24; P3 = 27 

□ Average waiting time: (0 + 24 + 27)/3 = 17 



Suppose that the processes arrive in the order 
□ The Gantt chart for the schedule is: 



Pi 



0 3 6 30 

□ Waiting time for P / = 6;P 2 = O.P 3 = 3 

□ Average waiting time: (6 + 0 + 3)/3 = 3 

□ Much better than previous case 

□ Convoy effect short process behind long process 
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Shortest- Job-First (SJF) Scheduling 

□ The SJF algorithm associates with each process the length of its 
next CPU burst 

□ When the CPU becomes available, it is assigned to the process that 
has the smallest next CPU burst (in the case of matching bursts, 
FCFS is used) 

□ Two schemes: 

Nonpreemptive - once the CPU is given to the process, it cannot be 
preempted until it completes its CPU burst 

■ Preemptive - if a new process arrives with a CPU burst length less 
than the remaining time of the current executing process, preempt. 
This scheme is know as the Shortest-Remaining-Time -First (SRTF) 

□ SJF is optimal - gives minimum average waiting time for a given 
set of processes 

■ The difficulty is knowing the length of the next CPU request 



Example of SJF (non-preemptive - simultaneous arrival 
(arrival-time=0 )) 
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□ SJF scheduling chart 
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□ Average waiting time = (3 + 16 + 9 + 0)74 = 7 
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Example : non-preemptive SJF (varied arrival times) 

Process Arrival Time Burst Time (assume millisecond) 
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□ SJF (non-preemptive, varied arrival times) 



0 3 7 8 12 16 

□ Average waiting time = ( (0 - 0) + (8 - 2) + (7 - 4) + (12 - 5) )/4 

= (0 + 6 + 3 + 7)/4 = 4 ms 

□ Average turn-around time: = ( (7 - 0) + (12 - 2) + (8 - 4) + (16 - 5))/4 

= (7+10 + 4+ ll)/4 =8ms 




□ Yank the CPU away from the currently executing process when a 
higher priority process is ready. 

□ Avoids "hogging" of the CPU 

□ On time sharing machines, this type of scheme is required because 
the CPU must be protected from a run-away low priority process. 

□ Give short jobs a higher priority - perceived response time is thus 
better. 



Example: Preemptive SJF [Shortest-remaining- 
time-firstl (SRTF - varied arrival times) 

Process Arrival Time Burst Time 
Pj 0.0 7 
P 2 2.0 4 
P 3 4.0 1 
P 4 5.0 4 
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□ Average waiting time 

= ([(0-0) + (11 -2)] + [(2- 2) + (5 -4)] +(4 -4) + (7 -5) )/4 
= 9 + 1 + 0 + 2)/4 =3 ms 

□ Average turn-around time =(16 + 5+1 + 6)/4 = 7 ms 



Example: Preemptive SJF LShortest-remaining- 
time-firstl (SRTF - varied arrival times) 

Process Arrival Time Burst Time 
Pj 0.0 8 
P 2 3.0 5 
P 3 5.0 2 
P d 6 .0 5 
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□ Average waiting time 

= ( [(0 - 0) + (10 - 3)] + [(3 - 3) + (7 - 5)] + (5 - 5) + (15 - 6) )/4 
= 7+0 + 2+0+ 9)/4 =4.5ms 

□ Average turn-around time = (15+ 1 + 2+ 14)/4 =9.5 ms 



Priority Scheduling 

□ The SJF algorithm is a special case of the general priority scheduling 
algorithm 

□ A priority number (integer) is associated with each process 

□ The CPU is allocated to the process with the highest priority (smallest 
integer = highest priority) 

□ Priority scheduling can be either preemptive or non-preemptive 

A preemptive approach will preempt the CPU if the priority of the 
newly-arrived process is higher than the priority of the currently 
running process 

A non-preemptive approach will simply put the new process (with 
the highest priority) at the head of the ready queue 

□ SJF is a priority scheduling algorithm where priority is the predicted next 
CPU burst time 

□ The main problem with priority scheduling is starvation, that is, low 
priority processes may never execute 

□ A solution is aging; as time progresses, the priority of a process in the 1 
ready queue is increased 



Example (non-preemptive) 
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□ Average waiting time = (0 + 250 + 375 + 850+925) / 5 = 480 ms 
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Round Robin (RR) Scheduling 

□ In the round robin algorithm, each process gets a small unit of 
CPU time (a time quantum), usually 10-100 milliseconds. After 
this time has elapsed, the process is preempted and added to the 
end of the ready queue. 

□ If there are n processes in the ready queue and the time quantum is 
q, then each process gets l/n of the CPU time in chunks of at most 
gtime units at once. No process waits more than (n-l)gtime units. 

□ Performance of the round robin algorithm 

q large => FCFS 

■ q small => q must be greater than the context switch time; 
otherwise, the overhead is too high 
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Process Burst Time 
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The Gantt chart is: 
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Typically, higher average turnaround than SJF, but better response time 

□ Average waiting time 

= ( [(0 - 0) + (77 - 20) + (121 - 97)] + (20 - 0) + [(37 - 0) + (97 - 57) + 

(134 - 1 17)] + [(57 - 0) + (1 17 - 77)] ) / 4 

= (0 + 57 + 24) + 20 + (37 + 40 + 17) + (57 + 40) ) / 4 

= (81 +20 + 94 + 97)/4 

= 292 / 4 = 73 ms 

□ Average turn-around time = 134 + 37 + 162 + 121) / 4 = 1 13.5 ms 
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Process Burst Time 
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The Gantt chart is: 
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Typically, higher average turnaround than SJF, but better response time 

□ Average waiting time 

= ( [(0 - 0) + (74 - 20) + (122 - 94)] + (20 - 0) + [(34 - 0) + (94 - 54) + 

(127 - 1 14)] + [(54 - 0) + (1 14 - 74)] ) / 4 

= (0 + 54 + 28) + 20 + (34 + 40 + 13) + (54 + 40) ) / 4 

= (82 + 20 + 87 + 94)/4 

= 283/4 = 70.3 ms 

□ Average turn-around time = 127+ 34 + 159 + 122) / 4 = 478/4 =1 19.5 ms 
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